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This* study examined the teaching effectiveness of a 
random sample of the University of Lethbridge Bachelor^Qf Education 
graduates and related various components of their success^o the 
performance of thkse same individuals as students within thV^eacher 
education program. Results are discussed in four major sectionsr (1) 
a description of the sample-, (2) factors influencing success as 
perceived by principals and by teachers; (3) analyses of the 
evaluations of success as assessed by the professor in student 
teachinq, the teacher self- evaluation r and the principal's 
evaluation; and comparison of professors' assesstaents of future 

teaching success and principals' evaluations of teaching performance. 
Results showed wh^t appeared to be a definite relationship between 
success in the program and success in ^teaching, but individual^ 
components of the program were not good predictors of success in 
teachinQ. References and examples of the questionnaires used in the 
study are included. (U3) N 
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ABSTRACT 



In tHe final analyses, a teacher education program must be evaluated 
in te-w (W the saoccess cf ^ts graduates. This study examined the teachimg 
effec ventess of a random sample of The University of Lethbridge Bachelor 
of E«uc#M« graduates and elated various components of their success tx> 
the performance o* those s&m individuals as students within the teacher 
education program. There aenpeared tc be a dtefinite relationship between 
success i*t th« program and success ir teacniirg, but individual components 
of i^he program were not puod predictor^ :f success in teaching. 
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INTRODUCTION 

PerhaiK the most problematic aspect of teac»r education concerns 
ensuring that graduates who h*ve attained a reqi? * :te> degree of su: :ess in 
a teacher education program, are in fact capable ^nrf. effective teasers. 
"Making ntftow nt judgements about probable teache* ^access during Ttea- 
cher] ptwwpatipn requires demonstrating that a cr^aarion employed during 
the preparatory program is * correlate of a later criterion intrinsic to 
work succiffts" Turner, 1974, p.87). The practice implications of this 
requirement wmzs si tat e demonstrating that criteria* characteristics, 
skills and *wc'niques contribute to teacher effectiveness before Issrey can 
be justifiec oeing of merit within an educatioi*al program. 

Very fe* teacher education programs are conducting .longitudinal 
studies to ewhiate the teaching effectiveness of their graduates and to 
identify cowwoents of the program which might have contributed to that 
success, o 5 ack of success. This study, which is a part of a much larger 
project kn*# as QAULTEP 1 , was designed to identify successful and unsuc- 
cessful tailing graduates of the University of Lethbridge B.£d. Program 
and to determine relationships between their teaching success anc tneir 
success within the teacher education program. It was the first sxudy 
within QAULTEP to collect teaching data on graduates of the program and 
therefore was conducted partially to examine and evaluate the research 
design and methodology, to identify limitations and weaknesses in the 
study, and to make recommendations for a major follow-up project presently 
in tlr: early planning stages. 

^QAULTEP is an acronym for the Qualitative Analysis of the University of 
of Lethbridge Teacher Education Program. 



Purpose and Objectives 

The major purpose of the study was to develop a collection of variables 
which appear to be the most valid and reliable for evaluating a teacher 
education program . Specific objectives were to: 

1) identify factors perceived to influence teaching success or teachers 1 
perceptions of success, 

2) determine components of teaching success as identified by teachers and 
their principals, 

3) determine the relationship between evaluations of performance in an 
education program and evaluatic is of performance as a practising tea- 
cher, and 

4) determine the validity of the professors ■'■ assessments of future teach- 
ing success in terms of the principals' evaluations of teaching per- 
formance. 

Review of the Literature 

.< "The validity of a teacher education program is determined ultimately 
by the production of teachers who perform more effectively in classrooms 
than had they not received such tminifig" 1 (Austii;, 1974, p. 13).. Upfortu- 
nately there are very few studies in ttoe , field - ich have been able to 
prove that teacher training does make a difference. Beery (1962), in a * 
study comparing provisionally certified beginning teachers with those who 
had completed the prescribed education program, concluded that the fully, 
certified teachers were "consistently and significantly rated by competent 
observers to be more effective" (p. 395). However, there have been very 
few studies of this type. In fact, Bausell and Moody (1973) maintained 
that "teacher preparation as provided by colleges of eduction Joes not 
result in student achievement" (p. 208). Turner (1973) disagreed, citing 
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several defects in the studies on which Bausell and Moody based their con- 
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< fusions. He asserted further that neither they nor Popham (whom they 
■z ted) had produced studies from whjch dependable information about teacher 
fTfltion could be extracted. Part of the problem, of course, is that it 
is -very difficulty if not impossible, to obtain a control group; that is, 
a group of "teachers" who have not had teacher preparation. 

A second, and perhaps more important problem, is that of defining 
teaching effectiveness. Sandefur and Adams (1976) stated that "teacher 
education institutions fail to effectively evaluate graduates primarily 
because of the profession's inability to determine what constitutes effec- 
tive teaching, ^and partly from a lack of evaluation tools and techniques" 
(p.^fl). They did go on to describe their model for the evaluation of 
teaching, which was basedon the assumption that both of those obstacles 
had been partially removed. 7 

Doyle (1975) indicated. that in spite of a flurry cf research actiyity, 
most studies have "failed to support the existence of stable and consistent 
relationships between teacher variables and effectiveness criteria" (p^2). 
He reiterated this theme in 1978. However, Gage (1978) believes that 
these conclusions can be questioned on several grounds. He agrees with 
Glass (1976) that studies with flaws in the design or analysis may still 
be valid. He states rurther that "...the true relationship, if any, 
between any single dimension of teacher behaviour and pupil achievement 
or attitude is protably low [and that] the teaching-learning process is 
so complex that any single significant variable in teacher behaviour 
should have only a low correlation. . .with student achievement" (p. 230) -. 
According to Gage, with the small sample sizes typical of most teacher 
studies, it is unreasonable to expect results to be significant at the 
.05 or .01 levels. 
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Gage's optimism should be encouraging to researchers who continue to 

believe that th? teacher effectiveness question can ultimately be answered. 
Doyle (1975) suggests that "the persistence of the belief in the answera- 
bility of the question, in the face of discouraging results, would'seem to 
be linked to the persistence of the personnel selection and evaluation 
problem faced by school administrator . .'. . If one is charged with the 
responsibility of finding and keeping 'good' teachers, he is forced to 
accept the premise that 'good 1 teachers are identifiable" (pp.15, 16). 

Although it may not be easy or even possible at thistime to define 
effective teaching, teachers are in fact being hired and evaluated and 
recommended or not recommended for certification. It appears that the 
person most directly responsible for evaluating th^teacher is the princi- 
pal and/or superintendent. When teachers are selected for positions, 
their prospective employers assume that because they have successfully 
completed a teacher education program, they will be "acceptable teachers". 
To follow that premise to its logical next step, the employer should be 
able to expect that those who obtained the greatest success in the educa- 
tion program, should become the most successful teachers. There has been 
/little evidence to show that this is in fact the case. Hall (1964) stated 
that "very little research evidence is available to verify or deny that 
teacher education institutions are doing an effective job in preparing 
future ^eStfteiNs" (p. 72)., Using pupil growth on standardized. achievement 
tests as a measur£N)f effective teaching, he found it to be of questionable 
value as j;he sole criterion but he did conclude that average pupil gains 
were higher for pupils taught by certified teachers. 

Turner (1975) identified two studies (Ducharme, 1970, and Greaves, 
1972) which led him to conclude that "ratings of student teaching perfor- 
mance consistently correlate with principals 1 ratings Of success in 
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teaching" (p. 103). Labribla (1965) concluded from a follow-up study of 
200 teechers that it is possible to predict success in the initial teach- 
ing experience based on the teacher's performance in student teaching. 
However, Pratt (1977), after a review' of several such studies, stated 
that "...generally low agreement has been found between in-training assess- 
'merits based on practice teaching and subsequent ratings by supervisors" 
(P.12). 

Criteria other than performance in student teaching have also been 
used to attempt to predict teaching effectiveness. Vittetoe (1977) 
identified 144 superior and 100 inferior first year teachers, based on 
principal ratings. He found that one-fourth of the superior teachers had 



had low GPA's in 



the education program and several of the failures had had 



high GPA's. He dlid find some relationship between teaching success., sub- 
ject area, and similarity to the student teaching experience. Ryans (1960) 
in a comprehensive 'research study of characteristics of teachers, concluded 
that academically outstanding students did sjcore significantly higher than 
other groups on rnany attributes considered to be characteristic of good 
teachers. 

V prt (1964) conducted a study of various techniques used to predict 

the success of teachers. Supervisors were e>sked to rate the teachers on 
the same evaluation fori* as the one used during the teachers' student 
Caching experience. Various personality and attitude tests such as the 
MTAI and the MMPI were also used as predictors. He concluded among other 
things that: 

1) "academic achievement ,in college does not seem to have any predictive 
value as to how successful a Student will be as a student teacher or as a 
teacher in his first year of experience", 2) "the results from personality 
• and teacher attitude inventoried. . .did not have any predictive 



value", and 3) "the best predictions of the future success of a student 
teacher, even though limited, can be made by the supervising teacher and 
the campus supervisors" (p.7Q). 

Anderson and Hunka (1963) .stated that "conventional research into the 
evaluation and prediction of teaching proficiency and criterion variables 
has reached a deacfe^d because negligible relationships exist within and 
ampng the various criteria of teaching proficiency, the ultimate criterion 
of pupil growth along desired dimensions, the immediate criterion of 'prac- 
tice teaching marks, and the intermediate criterion of principals 1 or 
superintendents' ratings" (p. 74). _l 

The use of principals 1 or superintendents' assessments as a measure 
of success in teaching has come under considerable attack. Hain and, Smith 
(1 968 )\ found that principals used criteria such as bus duty, playground \ 
and cafeteria duty . and observation while the teacher moved frjom one class 
to another, more often than formal observation or classroom visits. Turner 
(1975) suggests that work success can be reduced; to three classes of cri- 
terion variables: student attainment, professional judgement and student 
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judgement. Sandefur and Adams (1976) utilize four categories of evaluative 
data: career line data, direct classroom observation, pupil, peer and 
supervisory evaluations, and standardized measures. Ryans (1960), however, 
stated categorically that "only time sampling involving replicated syste- 
matic observation by trained observers produces sufficiently reliable 
results to recommend its use in fundamental research" (p.374). He^does 
allow that other data would be acceptable for broader discrimination. 

In spite of the weaknesses in the utilization of principal and self 
evaluations, it was decided to. use these assessments as the initial mea- - 
sures of teaching success far this study. Principals are in fact evalua- 
ting teachers, and they do have considerable impact into the teacher 



education program. This was the initial attempt at evaluating teaching 
graduates and the opinions and cooperation of the principals were consi- 
dered to be crucial for this study' and for the follow-up study which is 
expected to utilize a more sophisticated evaluation system. 
Methodology 

2 

This study was one of many studies within the framework of QAULTEP. 
QAULTEP is a longitudinal project which has as its ultimate goal the develop 
ment of a model for the evaluation of teacher education programs. The data 
bank now contains approximately 40C variables on each of 600 students in 
three ^populations, created for the purposes of replication and validation. 
The variables include biographical information, pre-education data, (for 
example, scores on several psychological, personality and English tests, 
and grades in the students' first two years of arts and science courses), 
evaluations in the three education practica, and much other education data. 
Many QAULTEP studies have examined relationships within and among the pre- 
education, selection and training categories of variables. However, this 
was- the first QAULTEP study to examine the teaching success of graduates 
of the program and to relate their teaching effectiveness to their per- 
formance within the education program.' 

The sample for this study consisted of a random selection of 50 
University of Lethbridge graduates who were in the second population of 
the QAULTEP study, who had completed their teacher preparation at The 
University of Lethbridge and had been awarded a B.Ed, degree, and who 
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For more information QgwQAULTEP, see Dravland, V. , and Greene, M. 
"Development of a^QdeFTor the Evaluation of Teacher Education Programs 11 . 
Paper to be present^at the American Educational Research Association 
Annual Meeting, San Francisco, California, 'April 8-12, 1979. 
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.- were teaching in a public school system in Alberta. Detailed questionnaires 
v were mailed to each graduate and, with his/her permission, to .the principal 
(see^AppeFftfix A). The questions related to placement and other factors 
thought to influence a teacher's success, and opinions about what consti-i 
tutes teaching effectiveness. One section of the questionnaire was identical 
to the instrument that had been used for the eval nation of the individual 
as a student teacher in the teacher education program. The principal was 
asked to evaluate the practising teacher using this same form; that is,/ 
us1n«3 the same 39 competencies on the 1 to 5 rating scale. Each teacher • 
independently completed a self-evaluation using the same criteria. 

Forty-six pairs of questionnaires and one individual principal ques- • 
tionnaire were returned for a response rate of 93%V In addition, a personal 
structured interview was conducted with 89% of the respondents. Much of 
the data collected from the interviews pertained to specifics of The Uni- 
versity o£ Lethbridge teacher education program; these results are not 
included in this report. 

Descriptive analysis appeared to be most appropriate for much of the 
data.. As well, the Chi-squSre test, multiple regression techniques, and 
factor analyses were utilized to obtain the greatest possible meaning from 
the considerable amount of available data. 

Limi tations , . 

No^attempt was made to define teaching effectiveness or teaching . 
success. The assumption was made that principals carf and do differentiate 
between good and poor tethers and that teachers themselves have percep- 
; tions of their own success. Therefore, principals 1 evaluations and self- 
evaluations were used as the measures of teaching success. The evaluation 
instrument listed 39 competencies and/or characteristics in four categories: 
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preparation, performance, personal attributes and. professional attributes. 
From the ratings on these 39 variables, principals were asked to assign 
the teachers a nuriser from 1 to 5 for "overall assessment of teaching suc- 
. cess 11 (this corresponded to the category "global assessment of performance 
on the student teaching evaluation form). Also, 'principals were asked to 
rank the teacher's success on a scale from 1 to 10 "relative to other 
teachers at the school". It was hoped that this qualifying phrase would 
make the ratings more comparable. However, it appeared to compound the 
problem as some principals ignored the statement and rated the teacher 
relative to all other teachers they had known or relative to their concept 
of the "ideal" teacher. Some principals stated that all their teachers 
were excellent that year. Therefore, two equally "good" teachers could 
have received very different ratings depending on the staffs to which they 
were compared. < 

A second major limitation in terms of data analysis was a -result of 
University of Lethbridge policies. The University of Lethbridge students 
spend two pre-education years in Arts and Science before entering the 
Faculty of Education. There are always some students who drop out during 
those first two years. In addition, all potential education students must 
take an Orientation to Teaching course in the first two years of arts and 
science .courses. Approximately 30 to 35% of those who take that initial 
education course do not enter the Faculty of Education. . According to an 
informal poll of Arts and Science faculty members, those who do enter the 
Faculty of Education are among the better students in their first two 
years §t the university. Also, a certain nurber of students who do enter 
the Faculty of Education do not complete degree requirements. In order 
to graduate, students' must receive at least a "C" in student teaching, and 
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a^ffniiwm GPA (grade point average) of 2.00 on a four point scale. There- 
fore, the sample was selected from a homogeneous group of highly qualified 
people. One -would ^ot expect to find significant correlations among such 
a, group. 

A third limitation concerned the size of the sample. With small; 
sample sizes and a iarge number of variables, the findings must be inter-^ 
preted with caution. Factor analyses especially may be misleading with a 
large number of -variables and a small sample size. The small sample size 
also made a full descriptive analysis difficult; in order to protect the 
anonymity of the respondents, some of the discussion had to be kept rela- 
tively general . 

The exploratory nature of the study must be kept in mind throughout 
this report. There was a very considerable amount of datax^ahd a well - 
designed follow-up study is necessary to clarify some, of the results and 
to be confident of the analyses. 
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RESULTS 

The findings of this study are discussed in four major sections: ■ 

1. a description of the sample, 

2. factors influencing success as perceived by principals and by teachers, 

3. ana!>sses of the evaluations of success as Assessed by the professor in 
student teaching, the teacher self-evaluation, and the principals 
evaluation, and 

.4. comparison of professors 1 assessments of future teaching success and 

principals 1 evaluations of teaching performance. 
Des cription or' the Sample 

Forty-seven principals and 46 teachers returned their completed 
questionnaires. For comparison purposes, the sample was limited to the 
46 teachers for whom there w,as a principal evaluation and a professor 
evaluation of student teaching; 27 were female and 19 weri male. All of 
the teachers had done their student teaching at The University of Lethbridge 
between 19 74 and 1976; five (11%) were in their first year of teaching and 
the remainder in their second year. They were teaching in various subject 
areas and at various grade levels from kindergarten to Grade 12. Most 
(83%) were teaching in public school systems, seven (15%) were in separate 
systems and one did not specify. School size ranged from 50 to 1,540 
students (M=382) and town size varied from less than 500 people to more 
than 500,000; 70% of the schools were in communities with fewer than 5,000 
people. All of the teachers were under 30 years of age, except possibly 
for six who did wot answer the question. , 

All the principals in the sample were male; 54? were oyer 40 years of... 
age, 41% were between 30 and 40 years, and only two Were undor 30. Eleven 
(24%) had been principals' or vice-principals for 15 or more years, 19 (41%) 
for 5 to 14 years, and the rest (35%), for fewer than five years. 
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On the whole, the principals appeared to be very pleased with The 
University of Lethbridge graduates. The principals were asked to rate 
the teachers on a scale from 1 to 10 relative to other teachers at the 
school. Only four teachers were rated less than 5.(M s 6.7j>). When rating 
themselves on the sajne scale, teachers as a whole were slightly more 
generous (M-7-05), but also a little more reluctant to assign themselves 
to the extreme ends of! the scale (see Tabic 1). 

TABLE 1 

>r t Frequency of Ratings Assigned to Teachers 



' 7 : 1 : ^~ ~ 

Rating* By Principal?. V By Self. 

1 ". . ' \ 0 0 

2 • -'■ 1 0 

3 . : . ' 0 - - . 1 

4 : 3 2 

5 , • 7 ,4 

6 ' 6. 5 

7 . 7 * 12 

8 . 11 15 

9 * - 2 5 
10 • * 3. , 0 

No response - 6 2 

Total " 46 .. - 46 

'M ., ( 6.75 V 7.05 

SO • , .. .182 1.45 



*Rating On a, 1 to .10 scale relative to other teachers at the school. 



Factors Influencing Teaching Success 

Principals and teachers were asked to indicate the tive importance 
of each of eleven factors in determining teaching success c id teaching 
failure (see Table 2) There appeared to be little difference between 
teachers 1 and principals 1 opinions or between factor* thought to contribute 
the most to Reaching success and those thought to be most important in 
determining teaching failure. In both cases, teachers and principals ranked 
classroom control, communication skills and preparation as the three most 
important^ factors. 

howevjer, when teachers 1 and principals were asked in a personal inter- 
view to identify the "single most important factor i redetermining teaching 
success", without the interviewer specifying any factors : from which to 
choose, the list that emerged was slightly different (see fable 3). Teachers 
most often mentioned factors relating to relationships witti children 
(empathy, rapport, love, etc.) wkile principals tended to -mention class- 
room management skills and personal attitudes more often. The same, ques- 
tion was asked with regard to teaching failure. Again, no attempt was 
made to de/ffne teaching failure/ In many cases, the response was "the 



opposite /of the previous answer". But many respondents interpreted the 
question as measuring very different qualities (also see Table 3). Class- 
room control appeared to teachers to be far more related to teaching 
failure tnan to teaching success.; It is interesting to note that only 
three persons in either group identified "having an effect on student 
learning" as the most important factor in teaching success or failure. 

When asked in the *i nterviews \ "If. you could replace 75% af your 
present teaching staff with whomever.you chose, would,' you retain this 
teacher?", principals gav£ the following responses: 
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TABLE 2 

Factors Thought To Contribute The Most To Teaching Success 

And Teaching Failure 



Bv ^incipals . By Teachers 

Weigr Rank Weighted M Rank 

— ; 1 : — 

Factors Teac uccess 



Classroom Control 


4.80 


1 


- 4.87 


1 


Cor*iTiuni cation Skills 


4.74 




• .4.61 


2 


Preparation 


4.65 


3 


4.54 


3 


Personality 


4.44 


4 


4.35 


5.5 


Knowledge of Subject 


4.30 


5 


4.41 


4 


Teaching Methods 


4.22 


6 


4.35 


5.5 


P 1 acemen t Su i tab i 1 i ty 


3.72 


7 


4.17 


7 


School Administration 


.3.56 


8 


4.09 


8 


Staff Interpersonal Relations 


3.54 


9 


3.98 


9 


Teaching Experience 


3.33 


10 


3.74 


10.5 


Student Characteristics 


3.23 


y 


3.74 


10.5 


Teaching Failure 


Classroonv Control 


4.87 


1 


4.76 - 


1 


Preparation 


4.65, 


2 


4.27'- 


. 3 


Cbwnunication Skills , 


4.45 


3 


4.41 


2 


Personality 


4.24 , 


4 


3.94 


4.5 


Teaching Methods 


4.04- 


5 


3.84 


6 


Knowledge of Subject 


3.82 


6 


3.94 


4.5 


School Administration 


3.54 


7 


3.46 


9 


Placement suitability 


3.47 


8 


3.83 


7 


Stasff Interpersonal Relations 


3.17 


■/ 9 


3.02 


11 


Teaching Experience 


2 f 96 


/ 10.5 

/■ : .- 
10.5 


[ 3.16 


10 ; 


Student Characteristics 


2.96 


3.54 


8 
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TABLE 3 



X 



Frequency of Factors Identified As Being The 
"Single Most Important Factor in Determining Teaching Success 

(Or Teaching Failure)" 



Factors Identified 



Most Important In 
Teaching Success 



Most Important In 
Teaching Failure 



Relationships with children 
(love, rapport, -empathy, 
caring)* / 

Personal attitudes and 
relationships 

Classroom management 

Preparation, planning 

Self-confidence, poise 

Dedication, sincerity, 
ambition 

Adaptability 

Effecting student learning 
Class size 

knowledge of subject 

/ 

Difficult children 
False idealism 
No response 



By By 
Principals Teachers Principals T eacher s 



8 



9 

0 
3 
3 

0 
I 
0 

1 

0 

d 

2 



15 



4 
5 
4 

2 

2 
2 
1 
0 
0 
0 
0 



14 

3 
2 
4 

0 
0 
0 
0 
1 
0 
1 



14 



10 

2 
3 
3 

2 
0 

0 
0 
2 
1 
0 



36 



41 



36 



41 



*For teaching failure, the factor mentioned would be "a lack of" a par- 
ticular characteristic such as classroom control , or the opposite o'f the 
- trait mentioned; e.g., "insincerity" rather than "sincerity". 
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Yes 


- 28 




Maybe • 


- 6 


14.6% 


No 


■ 7 


17 ,|U 




41 


100% 



Many of the principals indicated ttrat their responses might have been 
different another year. It must also be remembered that the principals 
were comparing these first and second year teachers to- other teachers who 
may have had many years of experience. Those 'who had answered "no 11 . gave 
the following reasons: 

1. lacking in dedication and ability, 

2. personality, 

3. lack of experience, ; 

4. too many fantastic teachers this year. / 

I 

It was hypothesized that teaching success would be related to job 

... -'■''■'/. 
satisfaction, and that factors such as teaching load, salary, community 

and social activities, and subject and grade level placement would affect 

the teacher's feeling of satisfaction. This hypothesis was not supported 

by the results of this study. v 

It was first determined that principals' and teachers' perceptions of 

these factors were very similar. Principals and teachers rated/the "teacfi7 

ing convenience" of ttie school in a similar manner; both rated/similarly 

.. ■" •■ - — - / ■ 

the community social activities and the teachers participation in the 
social activities. There were slight differences in the assessments of 

... y , I 

the teachers' teaching load and extracurricular^ activities./ However, ,, ; 

.■'.-,'.■.'.'■/" . / 
most of the principals (82%) and about two-thirds of the teachers them- 
selves rated their teaching loads comparable to_ that of other teachers; 
16% of the principals rated the teacher's assignment heavier than average 



as did 29% of the teachers. 

The principals' ratings and overall assessments, and the teachers' 
self-ratings and overall assessments were then crosstabulated with size 
of school, community size, participation in social activities, teaching 

load, teacher satisfaction with salary, time spent in extra-curricular 
activities, number of teachers in the^school, and subject and grade level 
^pfacement. None of the relatTonsips were statistically significant; nor 
were any particular trends evident in the analysis. There did appear to 
be some relationship between the teacher's feelings of satisfaction with 
his/her particular teaching assignment 2nd the principal's overall assess- 
mefnt of success (£=.95) and his rating cn the 1 to 10 scale (£=.06). Of 
those rated above average, 94% were satisfied; of those rated below average 
only one-fourth were happy with their assignments. Only three teachers 
indicated that they were very unhappy with th£ir teaching assignments. All 
three were below average on the principals 1 overall assessment of success. 

Analysis of Success as Determined by Professors, Pri; :ipa1s and Teachers 

Overall Assessments . For each of the three evaluators there were two 
overall measures of success: for professors, the "global assessment' 1 
category op the student teaching evaluation form and the grade in student 
teaching; for principals and teacher self-evaluations, the "overall assess- 
ment of teaching success" category on the evaluation form and the rating 
on the 1 to TO sdale. As one would .expect,, the relationship between each 
of the two measures for each of the three evaluators was significant 

(£<.0l). \ 

There was no apparent relationship between the principals' ratings 
of teaching' success and the teachers' self ratings; only for 18 (47%) of 
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the 38 teachers who had both principal anc^ self ratings, were the ratings 
similar. Ten (26%) of the teachers rated ^lemselves higher than did 
their principals; the same number rated themselves lower. The. grade 
received in the student teaching practicum did not appear to be related 
to either principal ratings or to teacher self ratings. 

Similarly, no statistically significant relationship existed among 
overall assessments by professors, teachers, or principals. The principal 1 
response to the question of whether he would keep the teacher given the 
opportunity to replace 75% of his staff was not related to grade in student 
teaching or to professors 1 assessments. Nor was it related to teacher self 
assessments. It was, of course, significantly related to the principals 1 
assessments (£=.000) and. ratings (£=.002). 

Ratings on Individual Categories of the Evaluation Form . None of the 
correlations between principal and professor ratings on the 39 variables 
on the evaluation form were statistically significant. However, with the 
large number of .variables;, (39) the small number of subjects (46), and the 
small range of scores (2 to 5), it was not surprising that the corre- 
lations were not significant* It seemed logical to. assume that different 
evaluators might be concentrating on different aspects of teaching ia 
order to arrive at their overall estimates of success. Therefore yie 39 
variables on each of the thjree evaluation forms were subjectrJ to ipuHiple 
regression techniques and /to factor analyses proceduries in an attempt to 
account for differences among evaluators. 
Multiple Repression ., For each of the three evaluation forms, the 
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"overall assessment o,f success" variables was used as the' criterion; each 
regression, was. also re-run using the 1 ta 10 rating of success, as the 
criterion for teachers and principals, and grade in student teaching as the 



criterion f or professors. In all cases, for a variable to enter the re- 
gression the F value for the next step had to be significant at the ,05 
level (Guilford and Fruchter, 1975, p. 368). 

For the professor evaluations with global assessment as the dependent 
variable, four variable's met the criteria, and together accounted for 79% 
of the variance (see Table 4). With grade in student teaching as the 
dependent variable, eight variables entered the regression and produced a 
multiple correlation of .974 with a standard error of .185. These results 
must be interpreted with caution since the sample size was small and it 
was therefore possible to account for a large portion of the variance. It 
is interesting to note, though, that in both cases, professors appeared to , 
concentrate on variables related to the student teachers 1 preparation and 
interaction with pupils. - 

For the principal evaluations, with/"overall assessment" as the depen- 
dent .variable, one variable (suitability of lesson materials and media) by 
itself accounted for 89% of the variance, and ! only one other entered the 
regression (see Table 5). These variables were ones which conceivably 
could have been rated by the principal without his every having observed the 
teacher teaching. With the 1 to 10 rating as the criterion variable, four 
variables; entered the regression and produced a multiple R of .969 with a 
standard error of ^ 524. Here classroom management and "self-image" charac- 
teristics were paramount. 

The teachers themselves appeared to place more emphasis on appearance 
and classroom control and management techniques (see Table 6), but it 
should -be noted that the portion of variance accounted for was smaller 
an^l the standard error was greater than for professors 1 or principals 1 , 
evaluations* 
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TA^LE 4 

Results of Multiple Regression Analysis on Professor Evaluations a 

i 



Dependent Variable = Professors 1 Global Assessments of Success 



Variable Entering 


Step 


Multiple R 


Motivation of pupils 


(1) 


.731 


Consistency of preparation 


(2) 


.824 


Respect & admiratign from pupils 


(3) 


.862 


Presenting information 


(4) 


\ .895 


Standard error - 0.323 

> 


\ 

«■ 


) 


V 

Dependent Variable 


= Grade In 


Student Teaching . > 


Consistency of preparation 


ll) 


1 CI A- 

.784 


Respect & admiration from pupils 


(2) 


.886 ■ 


Presenting information % 


(3) 


s 

.925 


Enthusiasm & vitality 


(4) 


.948 


Handling routines 


(5), 


.956, 


Voice quality 


(6) 


. .964 


Initiative ; 


*'(7) 


.971 


Adaptability 


(8) 


. ■ • .975 



Standard error = . 1 85 



TABLE 5 

Results of Multiple Regression Analysis on Principal Evaluations a 
Dependent Variable = Principal's Assessments of Teaching Success 

: : — — *r 

Step Multiple R 

(1) .944 

(2) .960 
Standard error = .248 

: : '. : ^ : 

Dependent Variable = Principals 1 Ratings 



Classroom management. (1) .897 

Self-concept (2) .941 

Self-evaluation X (3) .957 

' Leading discussioti (4) .970 

Standard error = .524 



Variable Entering 

—Suitability of lesson materials 
and media 

Justifiable self-confidence 



a) N=24 
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TABLE 6 

Results of Multiple Regression Analysis on Teacher Self Evaluations a 



Dependent Variable = Self Assessments of Teaching Success 



Variable Entering 


Step 


Multiple 


Personal appearance 


(1) 


.412 


Classroom control 


(2) 


.631 


Planning ability 


(3) 


.695 


Creativity 


(< 


.800 


Maturity and judgement 


■ (5) 


.848 


Handling routines 


(6) 


.879 



Standard, error = .787 

. ' ( 
Dependent Variable = Self Ratings 

Classroom management 
Initiative 

Standard error = .933 
a) N=28 



(2) 



,590 
,740 



ERIC 



23 



23 

Factor Analysis . Factor analysis using an orthogonal solution was 
conducted on the 39 variables in each of the professors' and principals' 
evaluations. A listwise deletion procedure was utilized; ttiaTTsT^a^es^^ 
were excluded fronuthe analysis if there was missing data on any one of 
the 39 variables. This reduced the sample size considerably and interpre- 
tations from the analysis may be very misleading. 

The factor analysis procedure was repeated several' times, first 

allowing the program to select the number of factors (9 were extracted), 

and then specifying the number of factors from 2 to 7. The most meaning- 

ful interpretation of the analysis appeared to be for four factors for 

each of the professors and principals. Tables 7 and 8 present the output 

from that analysis. Loadings are indicated whenever they wen^the highest 

for that variable or were .6 and above, or had very little difference' 

between them. All loadings presented were significant beyond the .01 

level based on the formula £<.01 = t 2,58SE where SE = r~ . It had been 

v n 

hypothesized that certain variables should have been grouped together as 
indicated by ths brackets in Tables 7 and 8. This hypothesis was based 
on the theory underlying the faculty's development of the evaluation form. 
For professors this hypothesis did not appear to have been supported; for 
example, the fourth factor seems to be a conglomerate of various qualities. 
Certain of the. other characteristics, especially in Factors 1 and 2, do 
logically go together, for example, the first four planning-type activities 
in Factir 2 and the last five characteristics in Factor 1- However, it 
would be difficult and inappropriate to attempt to name these factors for 
such a small sample. 
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TABLE 7 



Professors 1 Evaluations Of The Student Teachers: 
Varlmax Rotation Following The Extraction Of Six Factors By Cocnnon-Factor Analysis a 



Variable Name 



Factor Loadings 



Academic background 
Planning ability 

Suitability of lesson materials & media 
Consistency of preparation 
Effectiveness of methods 
Motivation of pupils 
Leading discussion 
Skill In questioning 
Handling pupil responses 
Presenting information 
Working with Individuals & small groups 
Variety In approach to presentation 
Pacing of lesson . ^ 
Creativity (originality) 
Adaptability 

Closure (culminating, sunmarizing, con- 
cluding activities) 

Skill in evaluating pupil learning 

Attention to individual differences 

Classroom management 

Classroom control 

Handl ing routines 

Giving directions 

Suitability of physical arrangement of 
classroom 

Personal appearance 

Classroom manner (poise, self-control) 

Enthusiasm & vitality 

Empathy for pupils 

Ssnse of humor 

Voice qua'iity 

Engl ish usage 

Self-concept 

^Initiative 

Dependability & punctuality 

Maturity & judgement 

Justifiable self-confidence 

Self-evaluation 

Response to criticism (receives & 
implements suggestions) 

Respect & admiration from pupils 

Interpersonal relations with school 
personnel 



.556 
.689 



.429 

.479- 

.473 



.616 



.477 
.540 
.738 

. vv/4 



.600 



.558 
.641 
.793 

.559 
.552 



.602 
.710 
.491 
.708 



.616 
.699 
.407 



.705 
.527 

.524 



.569 



.672 



.680 



.633 
.550 



.592 



.696 
.532 
.647 

.598 

.576 



.436 
.465 



.603 
.557 

.463 



.821 



.585 



.534 



a) N - 38 



TABLE B 



Principals- 1 Evaluations Of The Practising Teachers: 
Varlmax Rotation Following The' Extraction Of Six Factors By Cotrmon-Factor Analysis a 



Variable Name 



Academic background 
Planning ability 

Suitability of lesson materials & media 
^Consistency of preparation 
Effectiveness of methods 
Motivation of pupils 
Leading discussion 
Skill 1n questioning 
Handling pupil responses 
Presenting Information 
Working with Individuals & small groups 
Variety 1n approach to presentation 
Pacing of lesson 
Creativity (originality) 
AdaptabffTlty 

Closures (culminating, summarizing/ 



concluding activities) 
:ill 1n evaluating pupil learning 
ttention to individual differences 
'lassroom management 
Classroom control 
Handling routines 
Giving directions 

Suitability of physical arrangement 
- of classroom 

Personal appearance 

Classroom manner (poise, self-control) 

Enthusiasm & vital ity 

Empathy for pupils 

Sense of humor 

Voice quality 

English usage 

Self-concept 

.Initiative 

Dependability & punctuality 
Maturity & judgement 
Justifiable self-confidence 
Self-evaluation 

Response to criticism (receives & 
implements suggestions) 

Respect & admiration from pupils 

interpersonal relations with school 
personnel 



.589 
.565 
.715 
.762 



.6B3 
.619 
.820 
.601 



.444 



.644 

.717 
.689 
.749 
.840 
.709 
.652 



Factor Loadings 



.492 
.578 
.713 
.754 



.45B 



.60B 



.627 
.603 
.815 
.647 
.733 
.777 
.685 

.675 
.819 - 



.564 
.564 



.496 
.581 



.B85 



.625 



.579 



.662 
.675 
.647 



.714 
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Principals 1 factors were a little easier to define; classroom control 
techniques were clearly identified in Factor 4 and professional charac- 
teristics appeared in Factor 2. However, included with the professional 
characteristics in Fuctor 2 were variables dealing specifically with 
teaching techniques. Factor 1 consisted mostly of personal characteris- 
tics and qualities that might be assessed outside the classroom. It 
was interesting to note that no matter how many factors were extracted, 
for principals the classroom control variables were always together as 
were the professional characteristics. For professors, planning-prepara- 
tion variables were always in the same factor. 

Predictions of Success and Principals' Evaluation 

The statistical analyses of the professors', principals' and teachers 1 
evaluations produced little in ternis of statistically significant findings. 
This was not surprising In the light of Gage's comments discussed previous- 
ly. In a study of this type a descriptive analysis is often more productive. 
Accordingly the evaluations were examined in some detail. There was an 
almost perfect relationship between the grade in student teaching and the 
professor's prediction of teaching success; that is, a "C" in student teaching 
corresponded to a prediction of average, success in teaching, a "B" corresponded 
to a prediction of better than average success and an "A" to a prediction 
of outstanding success. 

One would hypothesize then that those who had received high grades 
and predictions in student teaching would also receive high ratings from the 
principals. However, althougTi a. M C" is usually considered to be an average 
grad^T^udents in The University of Lethbridge Faculty of Education must 
have at least a "C" standing to graduate from the program; this requirement 



32* 



27 

has had affect of raising the actual average to a "B". Therefore, it was 
predicted that students who had received an "A" in student teaching would 
also have received an assessment of 4 or 5 and a rating of at least 7 or 
bettef from the principal. This prediction was supported for seven out 
of the eleven students who had received an "A" in student teaching. (One 
student had not received a rating from the principal.) One would also. ex- 
pect "B" students to have received a rating somewhere between 5 and 8. 
Again, all but three of the eight "5" students who had principal ratings - 
supported the prediction. Similarly "C students rould.be expected to have 
received ratings of 6 or less. This was. the arec in which the greatest 
discrepancy was found; six of the eleven "C" students received ratings 
higher than a 6 and three received a 6. 

Certain trends were apparent for those teachers who did not "fit" the 
expectations. Of the three students rated highly (A) by the professors but 
low (<7) by the principals, one was actually. assessed very highly in the 
interview and the principal indicated that he would definitely keep the 
teacher on staff. The low rating occurred because of the large nypbers of 
"well above avera e" teachers at the school. Another of the "A" student 
teachers had left teaching and indicated disillusion with the system. The 
other had had, according to the supervisors, a detrimental experience in 
another school, which added to the problems of disorganization and class- 
room control , 

Of the three "B" teachers who did not "fit" , one was assessed higher 
by the principal and two lower. Both of those assessed lower were in large 
city schools where the supervisor was rating relative to a larger number 
of teachers and presumably where the choice was greater. The teacher rated 
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higher was in a small school in a rural area. This does not imply that teache 
in larger schools were assessed lower than the others; several of the highly 
rated teachers were in large urban schools. 

All sevsn of the "C" teachers ranted highly by their principal s. were in 
rural areas. Most of their professors had indicated that with additional 
experience they could become very effective teachers. Many had also indicated 
a need to develop greater confidence. Presumably these teachers had developed 
this confidence with this additional experience in the rural setting. 
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DISCUSSION 

The mai or purpose of this study was to develop a collection of 
variables which are valid and reliable for evaluating a 'teacher Education 
program. A secondary purpose was to evaluate the design and methodology 
of the study with a view to conducting a similar, but more. extensive 
follow-up study of University of Lethcridge teaching graduates. In light 
of thfe findings of this study, it appears- to be premature to present a 
list of variables useful for evaluating a teacher education program. It 
must be remembered that this was an exploratory study and to expect to 
have completely achieved that primary purpose, from a preliminary s^tudy of 
only 46 teachers wa^ unrealistic. However, the design of the study and 
the techniques utilized appear to have been appropriate and with some 
modifications, should be applicable in the proposed future study. 

In spite of the exploratory nature of the study and its limitations, 
there were several findings worthy of note. 

1. Generally, principals were pleased with The University of Lethbridge 
teacher education program and the first and second year teaching 
graduates of thje program. This was evident in their assessments 

of the teachers 1 success (only four were rated at less thati a "5" 
on the 1 to 10 scale relative to other teachers, many of whom had 
had several years of experience), their responses to the question 
of whether or not they would keep the teacher given the option to 
replace 75% of their staff, and from their comments during the 
interviews. 

2. Relationships among grades in student teaching, principals', 
assessments and ratings of teaching success, teachers' self 

■ assessments and ratings, were not statistically significant. 
Nor were correlations between professor and principal ratings 



on any of the 39 variables on the evaluation form significant at • ^ 

the .05 level. However, these findings were not unexpected given^ 
the large number of variables, the small 'sample size, and the 
complexity of "teaching success". 

There did appear to be a definite link between success in the ... 
program and success in teaching. The criteria used to evaluate 
the student's success in the program were directly related to 
the professors' assessments of success in the program, the grade 
in student teaching, and the profpssors' predictions of success 

in teaching. Professor predictions of teaching success were 

7 

fairly closely associated with £n expected assessment of teach- 

/ . ✓ . .. 

ing performance. There was a certain overlap in the expected 
performance of "A" & "B", and "B" & "C" students, and there' . 
were several students for whom the predictions were completely 
invalid. These discrepancies appeared to result from a combina- 
tion of situational and personal factors, many of which are 
beyond the control of the teacher education institution or the 
school system. ' " 

Based on the findings of the regression analysis, principals appeared to 
be assessing their teachers in a more "global" manner than professors. 
They also appeared to be utilizing criteria that could have been observed 
outside the classroom; for example, utilization of materials and media, 
self-confidence, etc. Many principals stated that time constraints had 
allowed them to actually observe the teacher in the classroom only once. 
Professors appeared to be using more complex criteria for 
evaluation, arid focused on factors that have to do more with 
teacheir-pupil interaction. 
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5. Until the study has been replicated on a larger sample, few conclu- 
sions can be drawn from the results of the factor analyses. However, 
it does appear that principals^ponsistently tended to group together 
those qualities that could have been observed outside the classroom, 
and thatj professors appeared , to consistently group together qualities 
which might have been assessed in on-campus activities (such as methods 
Classes), rather than in the classroom setting, 

6. Principals and teachers agreed on their selection of factors con- 

. tributing the most to teaching success and teaching failure" However 
when asked in the interview to state the single most important factor 
in teaching success and failure, teachers mentioned -"relationships 
with* children" most often, whereas "principals most frequently men- 
tioned classroom management skills. 

. Factors such as grade and subject placement, participation in 
community activities, salary, extracurricular assignments, 
school size, etc., did not appear to be related to principals 1 
assessments of teaching success or to teachers 1 assessments of 
their own^success. However, the teachers 1 feelings of satis- 
faction with their teaching assignments did appear to be related 
to success. 

. Teachers in rural schools tended to be rated slightly 
higher than their urban counterparts. ,The reason for this 
appeared to be that inost graduates preferred to teach in the 
urban areas; consequently urban schools are able to select 
their teachers from the top graduates. This statement is sup- 
ported by ^the fact that 87% of the teachers who had received 



a "C" in student teaching were employed in communities with 
fewer than 5,000 people. This is compared with 67% of the "B M 
teachers and 40% of the "A" teachers who were teaching in rural 
areas , 

Recommendation for Further Study 

The major recommendation from the findings of this study is that 
the researchers should proceed with a major study on a larger sample 
of University of Lethbridge graduates, with the main purpose and objec- 
tives being similar to those of the present study. The methodology 
and design of the new study should be similar except that in addition 
to using principals' 1 assessments of teaching success, a major criterion 

of. success should be an evaluation oy trained observers. These observers 
should be trained by The University of Lethbridge Faculty of Education in 
the use of the evaluation instrument^ and methodology that is utilized by 
faculty supervisors. The trained observers would then observe these 
teachers in the classroom on a given number of occasions, thus increas- 
ing the inter-rater reliability. The use of the CIDAT 3 equipment could 
facilitate this procedure and make the observations more meaningful . 
The qroundwork for this procedure was laid during the present study when 
each of the principals and teachers were asked durinq the interview if 
they would agree to such a procedure. All of the principals agreed 
readily but a few of the teachers voiced concerns depending on how the 
observations would be conducted. 



CIDAT stands for Computerized Interactive Data Acquisition Terminal 
which is a microminiature computer, programmed to hetp gather data 
from groups of people. 
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If a definite relationship can be established between evaluations 
in student teaching, and evaluations of teaching by trained observers, 
and if a collection of variables can be identified as being valid for 
evaluating a teacher education program and success in teaching, then 
principals could be trained to evaluate their teachers using these 
criteria. ^ 
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FACULTY OF EDUCATION 
•RESEARCH CENTRE 



I lie University 
CX Lnthhricfee 

'.at jAf > ; x 2fM ■ January 9, 1978 



Dear Teacher, 

We are requesting your assistance in collecting data for a study which we 
believe will have majot significance for the education of teachers in Alberta. 

The study begins the third phase of a long-term project designed to evaluate 
The^ University of Lethbridge teacher education program. The project is an 
integral part of the Faculty's academic plan. During the first two phases 
of the project we have examined various selection and pre-education factors, 
their relationship to success within the program, and the relationships between 
and among various components of the program itself. This third phase is 
designed to determine whether the faculty evaluation of success within our teacher 
education program correlates with teaching success as assessed by teacher 
self-evaluation and principal evaluation. We also wish to examine factors which 
may contribute* to or detract from a teacher's success or tfis/her perceptions of 
sutcess. 

The enclosed questionnaire is designed to provide us with information 
necessary to begin Phase III. You are one of fifty University of Lethbridge 
graduates teaching in Alberta who have bo€nselected at r^r.dom to receive a 
questionnaire evaluating their teaching /success. 

In addition, a questionnaire and letter for your principal are also enclosed.' 
Please give your principal his/her copy of the questionnaire and letter and return 
envelope. We would like you and your principal to complete your questionnaires 
independently and return them at your earliest convenience. Two self-addressed 
return envelopes are provided to maintain coftf identiality . 

Although the questionnaire requires some thoughtful consideration on your 
part we believe it can be completed within 45 minutes and we very much appreciate^ 
your cooperation. , 



THE UNIVERSITY OF LETHBRIDGE 



January 9, 1978 
Page 2 



/ 

/ 
/. 



We are looking forward to a personal visit with ytfu sometime in the next 
few months to obtain greater feedback on the questionnaire itself and on other 
aspects *>f the study. 

You will be notified wh^n the initial report has been completed and 
copies will be available f oi> all those involved in the Study. We have enclosed 
a keepsake for you in the *£brm of an uncirculated silver dollar. 



Thank you again fo^ your assistance, 



Yours sincerely, 

Dr. V. Dravland 
COORDINATOR 



Mrs. M. L. Greene 
ACADEMIC ASSISTANT 

Encs. 
MLGrHM 
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39 



The number associated with eech queetlon (e.g. 6.1 to 6.5) are Inserted only for the convenience of the keypunch operators and should not 
.Influence your responses In any way. 

SECTION I 

This section Is designed to provide Information on factors that may affect a teacher's feelings about his/her position and therefore may 
Influence his/her success, or perceptions of success, In teaching. You are asked to Indicate your first Impression for all questions except those 
dialing with demographic Information (e.g. years teaching experience, sex, etc.). 

SECTION I! ♦ 

This particular form Is being used for your evaluation of your teaching because It was used In your student teaching and we wish to determine 
relationships between the two. Please give very thoughtful consideration to your responses and when* you are unable to make an objective 
Judgement, please respond with "don't know". 

SECTION III 

We hope to determine which factors are considered by practising teachers and principals to be the most Important In influencing teaching 
success. This section Is particularly Important for our long-term plans for determining the characteristics of an effective teacher. Phase read the 
instruction carefully. 



'SECTION IV 

This section is designed to provide Information on factors such as class size, grade level, student-teacher Interaction, etc. that may or may not 
affect a teacher's feelings of satisfaction In his/her position. Directions for completing this section are on page 5. 

EVALUATION OF TEACHING SUCCESS 
TEACHER QUESTIONNAIRE 



1 . How many years teaching experience have you had? 

6.1 . this is my first year 

6.2 1 to 4 years ' 

6.3 5 to 9 years 

6.4 10 to 14 years 

6.5 1 5 or more years 

2. How many years have you been teaching at this school? 



.5; 



7 1 
72 
7 3 

7.4 
7.5 



this is my first year 
1 to 4 years 
5 to 9 years 
10 to 14 years 
15 or more years 



How do you rate the physical design of your 
convenience? 



\ 



8.1 
8.2 
83 
8.4 
8.5 



excellent 
very good 
good 
fair 
poor 



schoc^Mi 



\ in terms of teaching 



How would you classify the social activities offered by your community? 
(Consider "social activities" as social, cultural, recreational, and sports 
events not organized by the school). 



9.1 
9.2 
9.3 
9.4 
9.5 



excellent 
very good 
good 
, fair 
poor 



To what extent do you participate in these community and/or social 
•ctivitres? 



10 1 
102 
10.3 
104 



a great deal 
a fair amount 
a little 
not at all 



How do you rate you r cunicular assignment relative to that of other teachers 
It school? 



11 1 

11.2 
11.3 
11.4 
11.5 



•RiC 



_ much heavier 
_ heavier 
_ comparable 

lighter 
... much lighter 



8. 



10 



11. 



12. 



13. 



How much time do you spend per week on ssslgned school-related extra- 
curricular activities? 1 



12.1 
12.2 
12.3 
12.4 



. less than 30 minutes 
. 31 to 60 minutes 
. 61 to 120 minutes 
. more than 120 minutes 



How much time do you spend per week on voluntary school-related extra- 
curricular activities? 



13.1 
13.2 
13.3 
13.4 



less than 30 minutes 
31 to 60 minutes 
61-1o 120 minutes 
more than' 120 minutes 



Do you feel that your salary provides appropriate compensation for your 
efforts? 



14.1 
14.2 
14.3 



underpaid 
adequately paid 
overpaid 



How far do you have to travel to school? 
I5.xy mile(s) 

Do you ever feel isolated from the community in which your school is 
located? J 



17.1 _ 
17.2 

17.3 _ 

17.4 _ 

17.5 _ 

If you- often or very often feel isolated what is the main reason? 

18.x 



. very often 
.often 
. sometimes 
. rarely 
. never 



Would you prefer to be teaching: 
in a different subject area? 



19.1 
192 



. yes (specify) 
. no 



at a different grade level? 



20.1 
20.2 



. yes (specify) 
. no 



in a different geographic location? 



21.1 
21.2 



yes (specify) 
no 



at a different school? 



22.1 
22.2 



yes (specify). 

no . 



at the same school but with different administrative philosophy? 

23.1 i yes (specify) 

23.2 no 



14. To what age group do you belong? 



24.1 
24.2 
24.3 
24.4 



15. Sex: 



25.1 
25.2 



40 



23 years or under 

24 to 29 years 
30 to 40 years 
41 years or over 



female 
male 



JECTIONII 

please rate your teaching success according to the following criteria Put an "X" in the column that most accurately reflects your evaluation of your present level c 
success Be as objective as possible 



/ 



/ 



?6 

28 
29 
30 
31 
32 
33 
>4 
3S 

36 

37, 
38 
39 
°40 

* 1 ' 
4? 
43 
44 
45; 
46 
47 

«* 

49 

50. " 
SI. 
52 



Preparation 
















Academic background 
















Planning ability 
















Suitability of lesson materials and media 
















Consistency of preparation 
















Performance 
















E ffectiveness ol Methods 






- 










Motw itton ol pupils 
















Lending discussion 

















Skill in questioning 


— 














Handling puptls ' responses 


- 








— : — 






Presuming information 


_ — 














Working with individuals and small groups 
















Variety in approach to presentation 
















Pacing of lessdn 
















Creativity (originality) 

, '- Ix_ — 1 ' 
















Adaptability 














i 


Closure (culminating, summarizing, concluding activities) 
















Skill in evaluating pupil learning * " ■ 
















Attention to individual differences 
















Classroom management ' 
















Classroom control 
















Handling routines ^ - 
















Giving directions 
















Suitability of physical arrangement of classroom 
















Personal Attribute* ; 
















Personal appearance 

> : : ^— • • ■ : ■ 












! ■ V 




^lassroom manner (poise, self-control) 

















9 



/ 



4" 



41 



• 54 


Enthusiasm and vitality 




4 . 


i 
3 


2 


1 


9 
















55 


Empathy for pupils 














! 


56 


Sense of humor 

















57 


Votes Quality 
















58 


Enolish usaoe (sra/nmar aoeflina mtinnitimii*m*\ 
















59 


Self'Cfjncept 








• 




• 




60 


Initiative 
















61' 


Professions! Attributes 
















$& 


Dependability and punctuality 
















63 


\* Maturity and judgement 
















64 


Justifiable sett-confidence 
















fi5 


Self-evaluation ' 
















66 


Response to criticism (receive^ and implements sugge* ons) 
















67 


Respect and admiration for pupils 














V 


68. 


Interpersonal relations with school personnel 
















69 


Overall Assessment of Teaching Success 

















On a scale from 1 to 10 with the number 10 being assigned to themoef effective teacher at your school and the number 1 being assigned to the Jeeef effective teacher at 
your school, what number would you assign yourself for your teaching effectiveness? 



70xy 



Do you believe you would be more effective: 
in a different subject area? 

72.1 yes (Comment) 

722 

723 



no 

don't know 



at a different school? 

74.1 ' 

74.2 

74.3 



yea (Comment) 
no 

don't know 



at a different grade level? 

^3.1 i yes (Comment) . 

73.2 no 

?73.3 don't know 

SECTION III 



For each of the next two questions put an ;X" in the box under the response 
that most accurately reflects your opinion 

Based on your experience how important is each of the following 
factors in determining tomching sticcees? 

75. Classroom control 

76 Communication skills 

l. 77. Knowledge of subject area 

78. Personality factors 

79. Placement suitability 
80 Preparation lor classes 

6 School administration 

7. m;i|| interpersonal relationships 

8 Student characteristics / 

9 htarhing experience < 
•10. Teaching methods j' 

11.- Other (specify) ■ 1 . . ■- 



5 
□ 
□ 

□ 
□ 
□ 
□ 
□ 
□ 
□ 
□ 
□ 



/ 



/ 

4 

□ 

□ . 

□ 

□ 

□ 

□ 

□ 

□ 

□ 

□ 

□ 



3 
□ 
□ 
□ 
□ 
□ 
□ 
□ 
□ 

□. 
□ 
□ 
□ 



2 
□ 
□ 
□ 
□ 

□ 
□ 

D 

□ ' 



1 

□ 

□ 

□ 

□ 

□ ' 

□ 

□ 

□ 

□ 

□ 

□ 

□ 



0 

ERIC 



47 



if 



on your experience how important it each of the following 
in determiningitMcMng Murt? 



12. Classroom control 

13' Communication skills 

W* Knowledge of subject area' 

15. Personality factors . 

Placement suitability 

17, - Preparation for classes 

19. School administration 

19. Staff interpersonal relationships 

20. Student characteristics 

21. Teaching experience 
. 22. Teaching methods 

23, Otner (specify) — 



5 
□ 
□ 
□ 
□ 
□ 
□ 
□ 
□ 
□ 
□ 
□ 
□ 



/ 

4 

□ 
□ 
□ 
□ 
□ 
□ 
□ 
□ 
□ 
□ 

o 
□ 



3 
□ 
□ 
□ 
□ 
□ 
□ 
□ 
□ 
□ 
□ 
□ 
□ 



2 
□ 
□ 
□ 
□ 
□ 
□ 
□ 
□ 
□ 
□ 
□ 
□ 



1 

□ 
□ 
□ 
□ 
□ 
□ 
□ 
□ 
□ 
□ 
□ 
□ 



. Each of the following factors has some effect on tmchlng competency. Select the 
thrm that you consider to be the most important and rmnk them in order of their 
importance. Assign the number 1 to the factor which you consider contributes the 
most ko teaching competency, 2 to the next most important, and 3 to the next most 
important. 

24. - classroom control 

25. knowledge of subject area 

26. - personality factors 

27. ~ placement suitability 

28. - - preparation for classes 

29. school administration 

30. — staff interpersonal relationships 

31. student characteristics . 

32. teaching experience 

33. teaching methods 

34. other (specify) — . 



Consider the concmpt of "teaching success". Then rmnk the following possible 
components according to their relative contribution to teaching succes\Assign 
the number 1 to the item that you consider contributes the most to teaching 
success. 2 to the next most important, and so on. \ 

\ 



35. 
36. 
37. 
38. 
39. 
40. 



adaptability to change 
. classrborp administrative efficiency - 
. effect on student learning 
. flexibility in interpersonal relationships 

placement suitability < 

teacher personality 



If CTION IV . 43 

tf your school operates on a "teaching cycle" other than the 5-day week, how many days are in each cycle? 
. . 41. days per cycle 



\ ■ ' • . i * 

consider the following chert and then complete the information requested according to how it applies to your particular teaching schedule. The last three 
ttjumne concern the type of interaction maintained between you and your classes (eg., whether purely lecture: low interaction, lecture and discussion with the class 
members participating: medium interaction, etc.), the level of satisfaction you feel as a result of teaching this class, and whether for some reason, you would choose 
ittner to teach or not to ieech this class if you had the option. 



Boysu 
Giris_ 



Boys_ 
Girls 

Boys 
Girls . 

Boys . 
Gir!s_ 

Boys. 
Girls_ 



Boys. 
Girls_ 



$ .... <j 



/ & ■ . if iff w - A 



II you wish to make further comment* about any topic raited In the questionnaire, or about the questionnaire Itself, pleate use the space below or the back of this page. 
Thank you again far your cooperation. V 




I hi* University 
Of LcHHiridge 



FACULTY OF EDUC^TiON 
H EHE ARCH CENT 



January 9, 1978 



Dear Principal, 

We are requesting your assistance in collecting 1 data for a study which we 
believe will have major significance for the education of teachers in Alberta. 

The study begins the third phase of a long-term project designed to evaluate 
The University of Lethbridge teacher education program. This project is an 
integral part of the Faculty's academic plan. During the first two phases of 
the project we have examined various selection and pre-education factors, y 
their relationship to success within the program, and the relationships between I 
and among various components of the program itself. This third phase is 
designed to determine whether the faculty evaluation of success within our ^teacher 
education program correlates with teaching success as assessed by teacher self- : 
evaluation and principal evaluation. We also wish to Examine factors which may 
contribute to or detract from a teacher's success or his/her perceptions of 
success. .. 

The enclosed questionnaire is designed to provide us with information 
necessary tb begin Phase III. Fifty of our graduates teaching in Alberta have 
been selected at random to receive a questionnaire evaluating their teaching 
success. 

In addition each principal is being asked to evaluate the teacher's present 
level of teaching success. We have asked the teacher to give you your copy of 
the questionnaire along with this ljetter and a return envelope. / We would like 
you and the teacher to complete your questionnaires independently and return 
them at your earliest convenience. TWo self-addressed return envelopes have , 
been provided to maintain confidentiality. 

Although, the questionnaire requires some thoughtful consideration on 
your part we believe it can be completed within 45 minutes and we very much 
appreciate your cooperation. 

• \ . ' 

2 

« « . . dm 




5J 
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45 



We are looking forward to a personal visit with you sometime in the next 
few months to obtain greater feedback 1 on the questionnaire itself and on other 
aspects, of the study. ■ 

You will be notified when the initial report has been completed and 
copies will be available for all those involved in the study. We have enclosed 
a keepsake for you in the form of an uncirculated silver dollar. 

Thank you again for your assistance. 




Dr. V. Dravland/ 
COORDINATOR 



K 




Mrs. M. L. Greene 
ACADEMIC ASSISTANT 



Enc8°. 
MLG:HM 



\ 
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EVALUATION OF TEACHING SUCCESS 
DIRECTIONS FOR PRINCIPAL QUESTIONNAIRE 46 

77i0 number associated with each question (e.g. G.1 to 6.5) ere Inserted only for the convenience of keypunch operator* end should not 
Influence your responses In any way. 

SECTION I 

TNa eecthn Is designed to provide Infonnatlon on lector* met may effect e teacher * feeling* about hie/her position end therefore may 
Influence hie/her succeea, or perception* of *uccee* f In teaching. You are aaked to Indicate your first Impression for ell question* except tho*e 
dealing with demograpMc Information (e.g. year* experience a* principal, *ex, etc.). However, If there ere que*tk>n* about the teacher for which 
you find tt difficult to decide the epproprtete response, pleeae do not gue**. 

SECTION II 

Thi* particular form la being used for your evaluation of the teechor beceuae It wa* used to evaluate his/her etudent teaching and we wlah to 
determine relationship* between the two. Please give very thoughtful consideration to your responses end where you are unable to m§k§ 9h 
obtecthte judgement, please respond with "don't know". 

SECTION III . - ■ 

We hope to determine which factors are considered by practising teachers and principals to he the most Important In Influencing teaching] 
success. This section Is particularly Important for our long-term plans tor determining the characteristic* of an effective teacher. Please reed th+ r 
Instructions ceretully. 



EVALUATION OF TEACHING SUCCESS 
PRINCIPAL QUESTIONNAIRE 



SECTION I 



H6w many years total experience have you had as a principal, vice- 8. What is the approximate* size of the community in which your school is 
principal, or assistant principal? °*"" |r> 

6.1 / _ this is my first year 

6.2 1 1 to 4 years 

6.3 5 to 9 years 

6.4 .10 to 14 years 

6 5 — 15 or more years 



For how many years have you been principal 
principal for this teacher? 

7.1 this is my first year 

7 2 2 to 4 years 

7.3 5 to 9 years 

7.4 10 to 14 years 

7 5 <5 or more years 

What type of school system are you in? 

8 1 public 

8.2 separate 

8.3 independent 

. 8.4 other (specify) _ — 



vice-principal, or assistant 



What grade levels are taught in your school? Check, all appropriate 
categories. 



10 



9.1 
10 1 
11.1 
12.1 
13.1 



. kindergarten 
. primary (i-3) 
. upper elementary (4-6) 

junior high (7-9) 
. senior high (10-12) 



What is your current school population? 
14 wxyz - students 

How do you rate the physical design of your school in terms of teaching 
eenvunlence? 

18 1 . r excellent 

18-2 - very good 

19 3 — , — gooo* 

18.4 fair 

18 5 poor 



11. 



12. 



What type of population does your school predominantly serve? 

19 1 rural — - , 

19.2 small community . 

193 suburban (to- ; Calgary or Edmonton) 

Q urban , 



located? 

20.1 
20.2 
20.3 
20.4 
20.5 
20.6 
20.7 
20.8 
20.9 



. less than 5do people 
. 501. to 1,000 people 
. 1,001 to 5,000 people 
. 5,001 to 10,000 people 
. 10,001 to 20,000 people 
. 20,001 to 30,000 peop f <* 
. 30,001 to 40,000 people 
. 40,001 to 50,000 people 
. more than 50,000 people 



How would you classify the social activities offered by the community In 
which your school is located? (Consider "social activities" as social, 
cultural, recreational and sports events not organized by the school.) 



21.1 
21.2 
21.3 
21.4 
21.5 



excellent 
very good 
good 
fair 
poor 



To what extent does this teacher participate in community and/or social 
activities? 



22.1 
22.2 
22.3 
22.4 
22.5 



. a great deal 
. a fair amount 
. a little 
. not at all 
. don't know * 



How do you r at eth is teac her 'scurrtculsr assignment relative to that of other 
teachers at your school? 

23.1 " much heavier 

23.2 heavier 

23.3 comparable 

23.4 -1 lighter "* * * * 

23.5 much lighter • 

How much time does this teacher spend per week on assigned school- 
related extracurricular activities? 



ERIC 



24.1 
24.2 
24.3 
24.4 
-) 24.5 



less than 30 minutes 
31-60 minutes 
61-120 minutes 
more than 120 minutes 
don't know . 



13 



14 



15 



How much time does this teacher spend per week on voluntary school- 
related extracurricular activities? 

25 1 less than 30 minutes 

25 2 31-60 minutes 

25 3 61-120 minutes 

25 4 more than 120 minutes 

25 5 don't know" ^ 

How many teachers are employed in your school 9 Insert the correct number 
for each category 

26 xy full-time female 

28 xy full-time male ^ 

30 xy • part-time female 

32 xy part-time male \ 

How many administrators are employed in your schoo 1 ? (Consider the 
following as administrators principals, assistant principals, vice-pi mcipals. 
and^eparlment heads J Insert the number for each citegdry 

54 fty J full-time female 

36 xy full-time male 

38 xy part-time female 

40 xy , part-lime male 



16 



17 



18 



19 



How many te^acner aides are employed by your school? Insert the number 
for each category • 

42 xy full-time female " ■ v " 

44. xy full-time male 

46 xy ; L part-time female 

48 xy part-time male • 



Is anyone in your school specifically assigned to assist newly graduated 
teachers? i. ■ 

50.1 . — yes (specify position) : \ 

50 2 no :■ 

To what age group do you belong? 

51 1 20 years or under 

51 2 24 to 29 years 

513 30 to 40 years 

51 4 _i 41 years or over 



Sex: 

52.1 
52 2 



female 

male 



SECTION JJ 



, Please rate this teacher's teaching succesaaccording to the following criteria. Put an "X" in the column that most accurately reflects your evaluation of tite/herpnaeanf 
level of success. Be as objective as possible. '" 



/ 



or 








5 


4 


3 _ 


2 


1 






9 


53. 


Preparation 

















54. 


Actdnmic background 
















55. 


Planning ability 


V 














56 


< Suitabihty m ol lesson materials and media 
















57. 


Consistency of preparation y 
















58. 


• Performance \ 
















59, 


Effectiveness of Methods - \ 
















60. 


Motivation of pupils 
















61. 


Leading discussion 
















62 


Skill m questioning 
















63 


Handling pupils' responses . 
















64 


Presenting information 
















65, 


Working with individuals and small groups 
















66. 


Variety in approach to presentation 














\ 


67. ~ 


Pacing of lesson 
















66 


Creativity (originality) 
















69. 


Adaptability 
















70. 


Closure (culminating, summarizing, concluding activities) 












o 




71. 


Skill in evaluating pupil learning 
















72. 


Attention to individual differences . 
















73. 


Classroom management 
















74. 


Classroom control 
















7 *P R I f^" andim 9 routines- 

















/ 



T ■ 
3 



■ / 
/ 

1 




Giving directions 
















Suitability of physical arrangement of classroom 
















Personal Attribute 

9 • ■ c ! . . , — 
















Persona) appearance 

• * 
















Classroom manner (poise, self-control) 
















Enthusiasm and vitality / 
















Empathy for pupils * | ' \ 
















Sense of humor 








* 








Voice quality 






i 










English usage (grammar, spelling, colloquialisms) 
















Self-concept 




- 












Initiative 
















Professional Attributes 
















Dependability and punctuality 






* „• ■ 


V-i 








Maturity and judgement 




j 












Justifiable self 'Confidence , 






—i 

1 










Self-evaluation 








J 


- 






Response to criticism (receives and implements suggestions) 
















Respect and admiration for pupils 
















Interpersonal relations with school personnel 
















Overall Assessment of Teaching Success 

















14. 



Dn a scale from 1 to 10 with the number 10 being assigned to the most 
effective facher at your school and the number 1. being assigned to the 
if effective teacher at your school, what number would you assign to this 
teacher for his/her teaching effectiveness? 



at a different grade level? 

25.1 yes (Comment). 

25.2 no 

25.3 don't know 



Do you believe this teacher would be more effective: in a different subject 
area? • 



24.1 — 

24.2 — 
24 3 — 



yes (Comment) . 
no 

don't know 



at a different school? 

26.1 yes (Comment) . 

26.2 no 

26.3 don't know 



SECTION Hr 

For each of the next two questions put an "X" in the box under the response that most accurately reflects your opinion. 



4 » '40 



Baaed on your experience hdw important is each of the following 
factors in determining fetching 9uccm*7 

?/ Classroom control 
,?H Communication skills 
?<* Knowledge of subject area 
"if j Personality factors 
:ii Placement suitability 
'A? Preparation for classes 
'A'A School administration 

(j4 " Staff interpersonal relationships 
Student characteristics V 
36 Teaching experience 
3/ Teaching methods r 
38 Other (spec fy) 



Based on your experience how important is each of the following 
factors in determining teaching fmlture? 



MM 
•10 
•II 
A? 
43 
44 

46 
47 

48 
49 

50 



Classroom control 
Communication skills 
Knowledge of subject area 
Peisonahty factors 
Placement suitability 
Preparation for classes 
School administration 
Staff interpersonal relationships 
Student characteristics 
Teaching experience 
Teaching methods 
Other (specify) _- ; 



/ 

5 

□ 
□ 
□ 
□ 
□ 
□ 
□ 
□ 
□. 
□ 
□ 
□ 



/ 



/ 

5 

□ 
□ 
□ 
□ 
□ 
□ 
□ 
□ 
□ 
□ 
□ 
□ 



6 

/ 












4 


•3 


2 


□ 


□ 


a 


□ 


□ 


□ 


□ ' 


□ 


□ 


□ 


□ 


□ 


□ 


□ 


□ 


□ 


□ 


□ 


□ 


□ 


□ 


□ 


□ 


□ 


□ 


□ 






□ 


□ 


□ 


□ 


□ 


□ 


□ 


□ 


A. 


/ 






/ 




A 

** 


4 


2 


□ 


□ 




□ 


□ 


□ 


□ 


□ 


□ 


□ 


□ 
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Each of the following factors has some effect on fetching competency ^lect the 
three that you consider to be the most important and mrtk them in order of their 
importance^ Assign the number 1 to the factor which you consider contributes the 
most to teaching competency, 2 to the next most important, and 3 to the next most 
important. 

5t . _ classroom control 

52 knowledge of subject area 

53 personality factors 

54 - placement suitability 

55 - preparation for classes 

56 . school administration 

57 . .. staff interpersonal relationships 

58 ._ student characteristics 

59 teaching experience x 

60 -.^ teaching methods 

61 other (specify) ' .. — _ : 



Consider the concept of "teaching success" Then n&o* the following possible 
components according to their relative contribution to teaching success. Assign 
the number 1 to the item that you consider contributes the most to teaching 
success, 2 to the next most important, and so on. 

62 adaptability to change 

63 - classroom administrative efficiency 5 

64 effect on student learning 

65. flexibility in interpersonal relationships 

66 placement suitability 

67 teacher personality 



Jfll O ymeke further comments about any topic raised in this questionnaire, or about the questionnaire itself, please use the space at the bottom of page 3, or insert 



•'ERJ.O 



Thank you again for your cooperation 



55 



